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(54) MOVING IMAGE PROCESSING METHOD AND PROCESSOR 
THEREFOR 

(57)Abstract: 

PURPOSE: To prevent the degradation of 
image quality and the generation of block 
distortion in moving image software aiming at 
a special effect by positively using a noise 
pattern with low condensation. ^ 
CONSTITUTION: The bit stream in conformity 
with an MPEG is generated by multiplexing 
the information on a noise pattern as the data 
of a user area on the compressed moving 
image data coded by an MPEG encoder 11. 
The moving image data that the compressed 
moving image in this bit stream is decoded by 

an MPE decoder 21 is composed with the noise pattern data based on the 
information on the noise pattern in the bit stream. 



•n 



T*V» 



http://wwwl 9.ipdl.inpit.go.jp/PAl /resuIt/detail/main/wFRqliaDA408 1 49466P 1 .htm 1 2/1 6/20 1 1 



r * 

JP,08- 149466, A [DETAILED DESCRIPTION] 



Page I of 6 



* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Industrial ApplicationJThis invention relates to the processing which codes 
dynamic image data to compression dynamic image data, and the processing 
which decodes compression dynamic image data to dynamic image data. 
[0002] 

[Description of the Prior Art]For example, prediction coding of the coding to 
compression dynamic image data from dynamic image data is earned out 
accommodative, and an orthogonal transformation and after quantizing, it is 
performed by carrying out variable length coding. Variable-length decoding is 
carried out, further, it is stored in the frame memory for reference if needed, 
and also decoding to dynamic image data from compression dynamic image 
data is performed by adding the data of a screen, for example, inverse 
quantization and after carrying out inverse orthogonal transformation. 
[0003]MPEG is proposed as a video coding standard. The user area is 
established in the bit stream based on this MPEG, and it enables it to add the 
data of not only compression dynamic image data but a user's request. 
[0004] 

[Problem to be solved by the invention]There is video software which inserted 
positively in some or all of a screen noise patterns (it uses in this meaning 
below pattern ., for example, pattern . which appears in the TV footage after 
the end of televising, to which spatial frequency is changed [ a degree ] at 
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random very highly, and in this Description). This plans to take out special 
effects, such as a feeling of a change of a scene, by noise patterns. 
[0005]The above-mentioned noise patterns are not suitable for above- 
mentioned prediction coding or orthogonal transformation, and its degree of 
compaction is very small compared with the usual picture. For this reason, in 
order to control the data volume after compression below on a certain level, 
control of enlarging quantization step width is needed. However, if 
quantization step width is enlarged, the problem that the image quality of the 
screen concerned deteriorates remarkably will arise. In the screen which has 
noise patterns in a part of picture, the problem that block distortion arises 
around it arises. 

[0006] In the video which uses the above-mentioned noise patterns positively, 
an object of this invention is to prevent degradation of image quality, and 
generating of block distortion. 
[0007] 

[Means for solving problem]This invention generates the bit stream which 
carried out multiplex [ of the information about noise patterns ] to the 
compression dynamic image data coded by the MPEG encoder as data of a 
user area, and was based on MPEG of the video coding standard, It is the 
time-varying-image-processing method which compounds the data for the 
noise-patterns display based on the information about said noise patterns in 
said bit stream to the dynamic image data which decoded said compression 
dynamic image data in said bit stream by the MPEG decoder. In the above, 
the dynamic image data inputted into the information and MPEG encoder 
about noise patterns is generable by carrying out an AID conversion 
respectively, after, dividing into a noise signal and a dynamic image signal the 
motivation picture signal which comprises noise patterns and video for 
example. It may constitute from predetermined coded data which shows the 
kind of noise patterns for the information about noise patterns, and data in 
which the field of noise patterns is shown. 

[0008]The MPEG encoder with which this invention codes dynamic image 
data to compression dynamic image data, It is a dynamic image processor 
which has a multiplexing means which generates the bit stream which carried 
out multiplex [ of the information about noise patterns ] to the compression 
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dynamic image data coded by said MPEG encoder as data of a user area, and 
was based on MPEG of the video coding standard. 

[0009]The separating mechanism which takes out respectively the information 
about the noise patterns which are compression dynamic image data and data 
of a user area from the bit stream to which this invention was based on MPEG 
of the video coding standard, The MPEG decoder which decodes said 
compression dynamic image data to dynamic image data, It is a dynamic 
image processor which has a means to generate the data for a noise-patterns 
display based on the information about said noise patterns, and a synthesizing 
means which compounds the dynamic image data decoded by said MPEG 
decoder and the data for said noise-patterns display. 
[0010] 

[Function]Noise patterns do not receive the coding processing by an MPEG 
encoder. It replaces with it and multiplex [ of the information about noise 
patterns ] is carried out to the user area in the bit stream of MPEG. In the 
decoding side, the information about the above-mentioned NOIZUHA turn is 
taken out from the user area in the above-mentioned bit stream, the data for a 
noise-patterns display is generated based on this, and the data for this display 
is compounded with the dynamic image data decoded by the MPEG decoder. 
[0011] 

[Working exam pie] Hereafter, the working example of this invention is 
described. The block diagram in which drawing M shows the composition of 
the system of the 1st working example, and drawin g 2 are the explanatory 
views showing the outline of processing by this system. 

[0012]The system shown in drawing 1 comprises the equipment by the side of 
an encoder, and the equipment by the side of a decoder. The dynamic image 
data from a video source, the data for a noise-patterns display, the audio 
information from an audio source, and parameter data are inputted into the 
equipment by the side of an encoder. It is coded by MPEG video encoder 1 1 , 
and let dynamic image data be compression dynamic image data. The data for 
a noise-patterns display is analyzed with noises analysis and the noise- 
patterns generation machine 12, and, thereby, the noise data which is the 
information about noise patterns is generated. Multiplex [ of these ] is carried 
out by the multiplexer 15. Here, multiplex [ of the noise data ] is carried out so 
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that it may become a user area of MPEG of a video coding standard. Multiplex 
[ of the data (compression dynamic-image-data + noise data) after multiplex / 
this / and the compressed audio data coded by the audio encoder 13 ] is 
carried out by the multiplexer 1 6. Multiplex [ of the parameter coded with the 
system encoder 14 ] is carried out to the data (compression dynamic-image- 
data + noise data + compressed audio data) after multiplex [ this ] by the 
multiplexer 17. In this way, the bit stream based on MPEG of the video coding 
standard is generated, and it is outputfed from the multiplexer 17. 
[0013]ln the decoder side, from the above-mentioned bit stream, first, a 
parameter is separated by the demultiplexer 27, a double sign is carried out by 
the system decoder 24, and it is considered as parameter data. Next, 
compressed audio data are separated by the demultiplexer 26, a double sign 
is carried out by the audio decoder 23, and it is considered as audio 
information. Next, compression dynamic image data and noise data are 
separated by the demultiplexer 25. The double sign of the separated 
compression dynamic image data is carried out by MPEG video decoder 21 , 
and let it be dynamic image data. Noise data is processed by noise-patterns 
analysis and the noise generation machine 22, and, thereby, the data for a 
noise-patterns display is generated. In this way, the generated dynamic image 
data and the data for a noise-patterns display are compounded, and it is 
outputted as decode image data. 

[0014] Drawing 2 shows typically the portion about dynamic image data and 
the data for a noise-patterns display among above-mentioned processings. 
That is, in the transmission (encoder) side, dynamic image data is coded apart 
from the data for a noise-patterns display, and it is considered as compression 
dynamic image data, and is carrying out multiplex [ of the noise data 
(information about noise patterns) generated from the data for a noise- 
patterns display to this ]. In the reception (decoder) side, the above-mentioned 
compression dynamic image data and noise data are separated first, Next, 
while carrying out the double sign of the compression dynamic image data to 
dynamic image data, the data for a noise-patterns display is generated from 
noise data, and a picture and the image composing (the inside of a figure, 
right end) of noise patterns are displayed with these complex data. 
f001 5] Drawing 3 shows typically the portion about dynamic image data and 
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the data for a noise-patterns display like drawi ng 2 about the 2nd working 
example. The method of generating the dynamic Image data of drawing 2 and 
the data for a noise-patterns display is concretely shown by drawing 3 . That is, 
in drawing 3, a dynamic image signal and a noise-patterns signal are 
separated from a motivation picture signal, and the dynamic image data of 
drawing 2 and the data for a noise-patterns display are generated by carrying 
out the A/D conversion of these respectively. ****** is the same as that of 
drawing 2 to future processings. 

[001 6] Drawing 4 s hows typically the portion about dynamic image data and 
the data for a noise-patterns display like drawing 2 and drawing 3 about the 
3rd working example. In drawing 4, noise data (information about noise 
patterns) is given by the noise information generating part as the coded data 
which shows the kind of noise, and data in which the field of a noise is shown. 
That is, noise data (noise kind + noise areas) is outputted from a noise 
information generating part, and multiplex [ of this ] is carried out to the 
compression dynamic image data obtained by coding of dynamic image data. 
Multiplex [ this ] is performed so that noise data may serve as a user area of 
MPEG of a video coding standard. In the reception (decoder) side, after 
separating compression dynamic image data and noise data (noise kind + 
noise areas) first, while carrying out the double sign of the compression 
dynamic image data to dynamic image data, noise data is inputted into a noise 
pattern generator, and the data for a noise-patterns display is generated. The 
above-mentioned dynamic image data and a synchronization are taken, the 
data for this noise-patterns display is compounded, and video and the image 
composing (the inside of a figure, top right comer) of noise patterns are 
displayed with this complex data. 
[0017] 

[Effect of the lnvention]As mentioned above, in this invention, noise patterns 
are not coded with an MPEG encoder, but it is carrying out multiplex [ of the 
information about a NOIZUHA turn ] to the user area in the bit stream of 
MPEG. In the decoding side, the information about the above-mentioned 
NOIZUHA turn is taken out from the above-mentioned user area, the data for 
a noise-patterns display is generated, and it is compounding with the dynamic 
image data which carried out the double sign of this by the MPEG decoder. 
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For this reason, degradation of the image quality of a screen which has noise 
patterns can be prevented, and block distortion can be prevented from arising 
in the periphery of noise patterns. 



[Translation done.] 
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JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 



CLAIMS 

[Claim(s)] 

[Claim 1]lt carries out multiplex [ of the information about noise patterns ] to 
compression dynamic image data coded by an MPEG encoder as data of a 
user area, A bit stream based on MPEG of a video coding standard is 
generated, A time-varying-image-processing method which compounds data 
for a noise-patterns display based on information about said noise patterns in 
said bit stream to dynamic image data which decoded said compression 
dynamic image data in said bit stream by an MPEG decoder. 
[Claim 2]A time-varying-image-processing method generated by carrying out 
the A/D conversion of it respectively in Claim 1 after dynamic image data 
inputted into information about said noise patterns and said MPEG encoder 
divides into a noise signal and a dynamic image signal a motivation picture 
signal which comprises noise patterns and video. 

[Claim 3]A time-varying-image-processing method which are predetermined 
coded data information about said noise patterns indicates a kind of noise 
patterns to be in Claim 1 , and data in which a field of noise patterns is shown. 
[Claim 4]An MPEG encoder which codes dynamic image data to compression 
dynamic image data, A dynamic image processor which has a multiplexing 
means which generates a bit stream which carried out multiplex [ of the 
information about noise patterns ] to compression dynamic image data coded 
by said MPEG encoder as data of a user area, and was based on it at MPEG 
of a video coding standard. 
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[Claim 5]A bit stream based on MPEG of a video coding standard to 
compression dynamic image data, Separating mechanism which takes out 
respectively information about noise patterns which are data of a user area, 
An MPEG decoder which decodes said compression dynamic image data to 
dynamic image data, A dynamic image processor which has a means to 
generate data for a noise-patterns display based on information about said 
noise patterns, and a synthesizing means which compounds dynamic image 
data decoded by said MPEG decoder and data for said noise-patterns display. 



[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not 

reflect the original precisely. 

2.**** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 

[Drawing 1]The block diagram showing the composition of the system of the 
1st working example. 

[Drawing 2]The explanatory view showing the outline of processing by the 
system of the 1st working example. 

[Drawing 3] The explanatory view showing the outline of processing by the 
system of the 2nd working example. 

[Drawing 4] The explanatory view showing the outline of processing by the 
system of the 3rd working example. 



[Translation done.] 
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